Periodic Gabor Functions with Biorthogonal Exchange: 
A Highly Accurate and Efficient Method for Signal Compression 
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We propose a new formalism for signal compression based on the Gabor basis set. By convolving 
the conventional Gabor functions with Dirichlet functions we obtain a periodic version of the Gabor 
basis set (pg). The pg basis is exact for functions that are band- limited with finite support, bypassing 
the Balian-Low theorem. The calculation of the pg coefficients is trivial and numerically stable, 
but the representation does not allow compression. However, by exchanging the pg basis with its 
biorthogonal basis and using the localized pg basis to calculate the coefficients, large compression 
factors are achieved. We illustrate the method on three examples: a rectangular pulse, an audio 
signal and a benchmark example from image processing. 

PACS numbers: 



I. INTRODUCTION 

In 1946, Gabor suggested using a lattice of Gaussians 
in time- frequency space for signal representation [l| . (Es- 
sentially the same lattice was introduced by von Neu- 
mann in quantum mechanics in 1931 [2]). The Gabor 
functions are constructed by shifting a synthesis func- 
tion in time and frequency such that each basis function 
9n,m(t) has the form: 



g n ,m(t) = g(t - na) exp(jmbt) 



(1) 



for n, m G Z where a and b represent time and frequency 
sampling intervals. By choosing the synthesis function 
g(t) to be concentrated in both time and frequency (e.g. 
a Gaussian as in Gabor's original proposal), each one of 
the Gabor functions is localized in a different region of 
the time-frequency plane. Gabor's original motivation 
was to use these localized g n ,m(t) functions as a basis set 
for the expansion of a signal s(t): 



^n,myn,m 



(t). 



(2) 



For an arbitrary signal, Eqj2]has a solution only if ab < 
2tt; for the case ab = 2tt, called critical sampling, the 
solution is unique. This expansion is potentially very ef- 
ficient for signals that contain different frequency compo- 
nents at different time intervals. Due to the localization 
of the basis set, one expects that only the basis functions 
in the active time-frequency regions are required for the 
expansion and therefore the representation of s(t) should 
be very efficient. 

The Gabor basis set has been widely adopted in signal 
analysis, where it is known as the Short Time Fourier 
Transform, but it is rarely used for signal compression 
and reconstruction. In fact, it is generally regarded as 
unstable for critical sampling [3] . The reason for the dis- 
parity between the concept and the practice can be traced 
to the non-orthogonality of the basis set. Balian and 
Low proved that the <7 n>m (£) cannot be made orthonor- 



mal without sacrificing the locality of g(t) in either time 
or frequency [4, 5]. In addition, the non-orthogonality of 
the basis makes the calculation of the Gabor coefficients 
c n ^m non trivial. In this regard, a major advance was 
made by Bastiaans |6j who showed that the coefficients 
can be represented as the inner product between the sig- 
nal s(t) and a basis set 7 n , m (t) that is bi-orthogonal to 
9n,m(t). However, in most cases Bastiaans's approach 
just transforms the non-trivial problem of finding c n?m 
to the non-trivial problem of finding jn,m(t)- For the 
few special cases where 7 n ,™(£) can be calculated analyt- 
ically, the Gabor coefficients are found to be delocalized. 

About ten years after Bastiaans's work, Wexler and 
Raz developed a discrete version of the Gabor expansion 
(henceforth 'DGE') that overcomes many of the earlier 
difficulties 0. The DGE applies to sequences s[k] with 
period iV/. In this formalism, the Gabor functions in EqJT] 
turn into the discrete sequences 



gn,m[k] g[k 



na] exp(-^-mbk) 



(3) 



for n = 0, N — 1, m = 1, M — 1, where a and b are 
the time and frequency sampling intervals respectively 
and obey the relation: Na = Mb = Ni. The synthesis 
sequence is now a periodic extension of some window 
sequence g[k] = g[k + INi] = g[k + Ni]. Analogous to 
EqEJ the expansion of s[k] is given by: 



N-l M-l 

EE- 

n=0 m=0 



^n,mtfn,m 



[k]. 



(4) 



The coefficients c n?m exist for MN > Ni and can be 
found by taking inner products between s[k] and a 
biorthogonal basis set 7 n>m [A;]. For critical sampling 
NM = Ni the coefficients c njlTl and 7n,™[&] are unique 
and in contrast to the continuous-time case, can be ob- 
tained simply by solving a set of linear equations. Never- 
theless, some of the drawbacks of the Gabor basis persist 
in this formalism. To understand why, recall that the 
Gabor representation is expected to be efficient because 



2 



of the time-frequency localization of the Gabor basis, 
9n,m[k]' But this expectation is based on the assump- 
tion that only the Gabor functions in the active time- 
frequency window are required for the expansion Eq.(|4]). 
It turns out that this key assumption is incorrect: the 
non-orthogonality of the basis leads to the counterintu- 
itive phenomenon that even Gabor functions localized 
where the signal s vanishes are required for the expan- 
sion in Eqj4j This derealization of the Gabor coefficients 
has been overlooked in many studies [l5l-[l7|: in other 
cases, the phenomenon was addressed by over sampling 
i.e. MN > A^[7H9j. When the oversampling is increased 
sufficiently, the bi-orthogonal set 7 n ,m[fc] become simi- 
lar to the Gabor set g n ,m[k] and the coefficients become 
more localized. However, oversampling is inefficient in 
the sense that a time-frequency region that was previ- 
ously overlapped by one Gabor function in is now over- 
lapped by many, and all of them need to be taken into 
account in the expansion in Eqj4j 

As a result of these difficulties, a different approach for 
localized time-frequency expansion was developed called 
the "wavelet" expansion Q , in which the time- frequency 
localization is achieved by scaling the synthesis function 
in addition to shifting. The great advantage of this ap- 
proach is that it allows one to construct a localized basis 
set that is orthogonal, and therefore bypass the problems 
of the Gabor expansion. 

In this work, we return to the original Gabor formula- 
tion and introduce two modifications that make the rep- 
resentation both stable and highly efficient. The method 
can also be combined with wavelet or pyramidal scaling, 
although this will be addressed in a separate publication. 
The first modification is that that Gabor functions are 
'convolved' with a Dirichlet kernel (a periodic sine func- 
tion), giving a periodic, Gabor-like basis that is guaran- 
teed to be stable since it spans exactly the time- frequency 
space to which Nyquist's theorem applies. (In the final 
expressions, all that appears are the original Gabor func- 
tions at the sample points.) Second, the non- locality of 
the coefficients is overcome by exchanging the role of the 
Gabor basis and its bi-orthogonal basis set. Specifically, 
the localized periodic-Gabor functions are used to calcu- 
late the coefficients rather that as the basis. We call the 
combination of the two innovations the "periodic Gabor 
method with biorthogonal exchange" , or pgb. In [10|, QJJ 
we applied the pgb to quantum mechanics with great suc- 
cess [22[ ; here we show here that the method can provide 
large savings for signal compression as well. 



where n and m are integers. Each basis function is a 
Gaussian centered at (t n ,cj m ) = (na + to, + ooo) 
in time- frequency space, where to and uo are arbitrary 
shifts. The parameter a = controls the FWHM 
of each Gaussian in t and uo space. Taking At — a 
and Auo = 2tt / 'a as the spacing between neighboring 
Gaussians in t and u space respectively, we note that 
AtAuj = 2tt so we have exactly one basis function per 
unit cell in phase space, so-called critical sampling. As- 
suming that the grid extends over the infinite time- 
frequency grid, the Gabor basis is complete as shown 
in P3. 

However, in any numerical calculation, n and m take 
on only a finite number of values. Consider a basis con- 
sisting of N Gaussian functions {gi(t)}, i = 1...7V, one 
per unit cell. Since the size of one Gabor unit cell is 
27r, the phase space area covered by the truncated Gabor 
lattice is: 

^Gabor = 2?r7V - ^ 

However, it turns out that there is a difference between 
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FIG. 1: (a) TV = 9 coordinate grid points and N = 9 Gabor unit 
cells cover the same area in phase space, S = 2nN '. Shown also is 
a typical Gabor function. Note that its boundary conditions are 
not appropriate for the rectangular area, (b) The periodic Gabor 
(pg) basis is a complete set for the truncated space. The pg basis 
functions are loosely speaking, periodic Gaussians whose centers 
are located at the center of each unit cell. 



II. THE PERIODIC GABOR BASIS 

The original proposal by Gabor was to use Gaussian 
functions on a time-frequency grid with critical sampling 
[3, 0|. Under these conditions EqJT] turns into: 

9n,m(t) = (—) exp(-a(t-t n ) 2 +ju m (t-t n )) (5) 



the truncated Gabor lattice and the truncated Gabor ba- 
sis: The latter is not complete for the Hilbert space de- 
fined by the rectangular area S Gahor = 2ttN because the 
boundary conditions are not appropriate. 

In order to develop a truncated Gabor-like basis set 
that is complete on the rectangular area in Eqj6] (FigJT]) 
we introduce a variant on the Gabor basis set with peri- 
odic boundary conditions. Consider x(t) to be a periodic 
signal with period T and band limited in Q. By sampling 
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x(t) at the Nyquist rate St = ^ at N = ^ sampling 
points {ti\, x(t) can be expressed in terms of its samples 
by: 



N 



x(t) = ^2x(U)D(t-ti) 



(7) 



i=l 



where D(t) are the Dirichlet or periodic sine 
functions [l3(| : 



D(t) 



sin(7Vftt/2) 
iVsin(fit/2) 

(iV-l)/2 

- ^ exp(jmOt). (8) 



m=-(iV-l)/2 

Therefore the set { AO)} = D(t-U) for z = 1, TV com- 
prises a complete basis set for the time-frequency rectan- 
gular space S D = 2TVL = 2NStf t = 2ttN. 

By combining the Dirichlet and Gabor basis functions 
we can generate a finite "Gabor-like" basis set that is 
complete on the truncated space given in Eqj6j 



N 



9m{t) = Y,3m{ti)D{t-U) 



(9) 



for m = l,...,iV. The new basis set is in some sense, 
the Gabor functions with periodic boundary conditions 
(henceforth, the periodic Gabor or 'pg' basis). We can 
write eq.(j9j) in matrix notation as: G = DG where Gij — 
gj(xi). By taking the width parameter a = (and 
locating a Gaussian function at the center of each unit 
cell) we can guarantee that the Gabor functions have no 
linear dependence and that the matrix G is invert ible, 
that is GG 1 = D. 

The invertibility of G implies that both the Dirichlet 
and the pg bases span the same space (FigJTJ. Therefore, 
x(t) can be expanded as: 



N 



t(t) = Y 9m(t)c m . 



(10) 



rn=l 



To find the coefficients a m we first define the overlap 
matrix, S, as the inner product between pg functions: 



Sij 



(9u9j) = / 9*(t)9j(i)dt 
Jo 

Y Y 9i(tn)9j(t m ) f ° D*(t- t n )D(t - t m )dt 

n=l m=l ^° 
N-l 

Y 3t(tn)9j(t n ) 



71 = 



or 



S = G f G. 



(11) 



(12) 



Using the completeness relationship for non-orthogonal 
bases [21], x(t) can be expressed as 



N N 



= Y Y 9m(t)(S 1 )mn(gn,x), 



(13) 



n=l m=l 

where, similar to EqJTTJ the inner product 

N 



(9n,x) = Y,9i( t n)x(t n ). 



Comparing Eq. ([13j) with Ea. (fT0|) we find that 



(14) 



N 



(15) 



for m = 1, N. Although the S matrix is localized, S _1 
is not; hence, Eq. [15] indicates that basis functions g m 
that are distant in time- frequency from the signal x, still 
contribute to the expansion because of S _1 . 

Equation [15] can be written in an alternative way: 



N 



?(t) = Y 9m(t)(b m ,x), 



where 



rn=l 



N 



(16) 



(17) 



for m = 1, N. We will call the {b m } basis the biorthog- 
onal Gabor or 'bg' basis since the pg and bg bases taken 
by themselves are non-orthogonal but are orthogonal to 
each other. This can be shown easily by: 



N 



(bi,9j) = Y^^dj^n) 

n=l 
N N 

m—l n=l 
N 

= ^ ^ Smj(S )im = Sij. (18) 



This biorthogonality property was used to great advan- 
tage by Bastiaans on the infinite basis set, but here the 
biorthogonality property holds on a truncated rectangu- 
lar region in the time-frequency space. 

So far the pg basis set provides two great advantages 
over the traditional Gabor basis set. First, in the original 
Gabor basis N functions give a very inaccurate expan- 
sion of x(t)[E[, whereas the periodicity of the pg basis 
makes the expansion exact for functions that are band- 
limited with finite support, bypassing the Balian-Low 
theorem. Second, the coefficients in the original Gabor 
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basis require knowledge of the bi-orthogonal basis, which 
in most cases is non-trivial to calculate. In the pg ba- 
sis, no knowledge of the bi-orthogonal basis is necessary 
(EqIT5]). Nevertheless, the compression is still problem- 
atic since, as discussed at Eq. [I5j basis functions that are 
distant in time-frequency from the signal still contribute 
to the expansion. 



III. ACHIEVING COMPRESSION: THE 
PERIODIC GABOR BASIS WITH 
BIORTHOGONAL EXCHANGE 

We now turn to the issue of compression. Gabor's 
original idea was to exploit the time-frequency localiza- 
tion of the basis functions to reduce the size of basis. 
This intuitively appealing ideas translates to the state- 
ment that a significant fraction of the basis will fulfill 
the relation: (g ni x) = 0, n = 1,...,M. However, there 
is an important subtlety — we cannot simply eliminate 
the states g ni since as noted at Eq. [15j even pg func- 
tions that are remote from the signal can contribute to 
the expansion. Nevertheless, we can take advantage of 
the near- vanishing (g n , x), if we exchange the roles of the 
bg and pg bases, allowing the delocalized bg functions to 
serve as the basis set for x(t). Then Eq JT3l becomes: 

N N 

< l ) = ^2 b n(t)d n = ^b n (t)(g n ,x). (19) 

n=l n=l 

By assumption, M of the (g n ^x) are zero, hence in or- 
der to represent x(t) in the bg basis set we need only 
N' = N — M basis functions. To emphasize, although the 
basis {b n (t)} has played a central role in Gabor theory 
since 1980, it has always been used for finding the coef- 
ficients of the Gabor basis. Equation [19] is a radical de- 
parture from the existing literature since the roles of the 
(periodic) Gabor and the biorthogonal (periodic) Gabor 
bases have been exchanged, with the bi-orthogonal func- 
tions now actually serving as the basis for the expansion 
of the signal and the localized original functions used 
for the calculation of the coefficients. Hence the name 
of the method, "periodic Gabor theory with biorthogonal 
exchange" , or pgb. 

As discussed above, a large number of the coefficients 
in the pgb method are expected to be close to zero. After 
eliminating the small coefficients by quantization or en- 
tropy compression, one can use the remaining coefficients 
and the corresponding bg functions to obtain an approxi- 
mate reconstruction of the original signal. We have found 
that the accuracy of the reconstruction, although quite 
good, can be further improved using a method developed 
by Porat[14j. The first step in Porat's method is to find 
a basis that is biorthogonal to the contracted bg set, i.e. 
by repeating the procedure of EqlTTland EqJT7]but with 
the role of the N pg functions played by the N' bg set. 
In particular, the S matrix is now defined in terms of the 
contracted set only. Then the desired coefficients are ob- 



tained by the inner product between this new biorthogo- 
nal set and the original signal. We will show results using 
the Porat correction below. 



IV. DISCRETE FORMULATION OF THE PGB 
METHOD 

The pgb method can be formulated for discrete se- 
quences as well as for continuous signals. Consider a dis- 
crete sequence x[n] of length iV, which can be viewed 
as samples taken at U = 0,1,..., N — 1 of an N pe- 
riodic signal x(t) that is band limited in the interval 
[— 7r,7r]. Let the Gabor grid consist of N t and Gaus- 
sians in t and uj spaces respectively such that NtN^ = TV. 
The parameters that define the Gabor functions in EqJS] 

are a - 2Ai - (iVF' to _ 2"' U ° 2 ' 

n = l,...,iVt and I = l,...,^. The pgb representation 
of the sequence is given by: 

N 

x(n) = J2b i (n)d u (20) 

i=l 

or in matrix notation: 

x= Bd, (21) 

where x is the length N column vector of the sequence of 
values, B is the N x N matrix with elements B n i = bi(n) 
and d is the coefficient vector given by EqJTH Using 
EqfTTIand the fact that g(n) = g(n), we find that: 

N 

bi(n)=J2dj(n)(S- 1 ) ji . (22) 

or in matrix form: 

B = GS" 1 = (G f )-\ (23) 

where we have used Eq. ([T2]) . Equation [23] can be written 
succinctly as BG^ = 1. The related equation GB^ = 1 
is also correct, but has a completely different physical 
significance — it corresponds to the expansion of the 
signal in terms of the original Gabor basis, without the 
exchange of roles with the biorthogonal basis; in other 
words it corresponds to a discrete pg representation. It 
turns out that this discrete pg representation is fully 
equivalent to the DGE. In fact, the equation GB^ = 1 
appears in [7|, albeit for just one column of the matrix. 



V. RESULTS 

We first address the difference in accuracy between 
the standard Gabor basis and the pg basis set with- 
out exchange. Consider the chirped Gaussian s(t) — 
(^l)i exp(-a(t-t ) 2 +iw (t-t )) with a = 0.135(1 + 
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z), to = 31.5 and wq = |. We will compare the re- 
construction using 64 Gabor and 64 pg functions. Both 
basis sets consist of Gaussian functions on an 8 x 8 time- 
frequency lattice. The Gabor coefficients were calculated 
using the procedure in |l4j. Figure [2f a) shows the real 
part of the original signal and the reconstructions ob- 
tained using both bases. Figure [2fb) shows the differ- 
ence between the reconstructed and the original signal. 
The norm of the error is 0.0347 for the Gabor basis and 
1.8e -5 for tl^pg basis. ^ 
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FIG. 2: (a). Reconstruction of a chirped Gaussian function using 
64 standard Gabor (red) and 64 pg (black) functions. The pg result 
is virtually indistinguishable from the exact result, (b) Deviation 
between the reconstructed and the original signal using standard 
Gabor (red) and pg (black) functions. 
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FIG. 3: Reconstruction of a rectangular pulse from 25 coefficients 
using the DGE method (red) and the pgb method (blue). 
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We now turn to compression using the pgb method. 
(By compression we mean using only a small subset of 
the coefficients for the reconstruction.) We present three 
examples. The first is a 1-d rectangular pulse, an impor- 
tant exmaple for signal processing. The second is the 2-d 
"Lena" picture, a benchmark for image processing. The 
third is an audio signal corresponding to a 'splat' sound. 
For each example, we compress the signal using a small 
subset of the coefficients and present the reconstruction 
from this subset. 

The rectangular pulse was studied previously by 
Wexler and Raz [7] . Following those authors we consider a 
rectangular pulse represented by a discrete sequence of 64 
points, compressed using 25 coefficients. The reconstruc- 
tion obtained with the pg basis is essentially identical to 
the one reported by Wexler and Raz using the DGE 
(see the discussion below Eq. [23]). However, with the pgb 
method the reconstruction is improved by essentially an 
order of magnitude (L 2 norm of the error is 0.3989 in 
the DGE and 0.0469 in the pgb method). Comparison of 
the spectrum in the DGE and the pgb methods (FigHJ 
demonstrates the much higher localization of the pgb co- 
efficients, specifically in the time coordinate (the signal 
is inherently delocalized in frequency). 

Several works have extended the DGE to two dimen- 
sion in order to apply it to image compression p~7M2Q| . 
Although the 2-d DGE reduces the entropy of an image, 
the entropy can be reduced much further using the pgb 



FIG. 4: The coefficients for representing a rectangular pulse in the 
DGE (red) and in the pgb method (blue). 



method. We will demonstrate this on the Lena image 
(Fig. Efa)), which is a benchmark for image compres- 
sion. The original image contain 512 x 512 pixels. Figure 
[5] shows the reconstruction of the image using only the 
2621 largest coefficients (« 1% of the coefficients), using 
the DFT (b), the DGE method (c) and the pgb method 
(e). The mean-square-error of the reconstructed image is 
417 in the DGE and 327 in the pgb method, but the dif- 
ference in visual quality is far more significant than these 
numbers indicate. Figure[5fd,f) shows the reconstruction 
of the image using 2621 coefficients when Porat's correc- 
tion is applied to both methods. The mean-square-error 
of the reconstructed image is 279 in the DGE and 144 
in the pgb method. Again, the difference in visual qual- 
ity is far more significant than these numbers indicate. 
The pgb result with Porat's correction is better than the 
DFT (mean-square-error of 173) with the same number 
of coefficients (Fig. Efb)). 

Finally, we consider an example of an audio signal, 
which demonstrates the advantage of the pgb represen- 
tation over the time and frequency representations. The 
original audio signal is sampled at 10000 sampling points. 
We used the pgb method on a grid of 100*100 unit cells 
in time- frequency space. Figure ((6]) shows the signal in 
the time, frequency and pgb representations. We recon- 



(a) (b) 




FIG. 5: Reconstruction of the Lena image using about « 1% (2621) 
of the coefficients, (a) original picture, (b) DFT. (c) DGE method, 
(d) DGE with Porat's correction, (e) pgb method, (f) pgb method 
with Porat's correction. 



structed the signal for various basis set sizes and calcu- 
lated the norm of the error (the difference between the 
original and the reconstructed signal) using both the orig- 
inal pgb coefficients also the pgb coefficients after Porat's 
correction. The results are shown in Fig. ([7]). For com- 
parison, we show results retaining the same number of 
DFT coefficients. Clearly, the pgb method allows much 
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Time(sec) Frequency Time(sec) 

FIG. 6: The splat signal in time, frequency and pgb representa- 
tions. 
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FIG. 7: The norm of the error of the reconstructed signal as a 
function of the number of basis functions using the DFT (red), the 
DGE with Porat's correction (green), the pgb (blue), and the pgb 
with Porat's correction (black). 



more compression than the DFT, but introduces some 
residual roughness. This roughness may be removed us- 
ing Porat's correction, although the latter involves some 
additional computational cost. 



VI. SUMMARY 

We introduced a new basis set called the periodic Ga- 
bor or pg basis which is effectively a 'convolution' of the 
Gabor and Dirichlet (periodic sine) functions. The orig- 
inal Gabor basis is complete for the infinite space but 
incomplete, and actually unstable for a truncated rect- 
angular region in time- frequency space. In contrast, the 
pg basis provides a complete and stable representation for 
a truncated rectangular area in time-frequency space, i.e. 
for the Hilbert space spanned by functions that are band- 
limited with finite support. Moreover, the coefficients in 
the pg representation may be calculated by simple matrix 
multiplication (EqJTSJ). 
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We noted that although the pg functions are local- 
ized, the corresponding biorthogonal bg basis functions 
that determine the coefficients are not. By exchang- 
ing the roles of the pg and bg bases, ("periodic Gabor 
method with bi-orthogonal exchange" or 'pgb') the co- 
efficients become localized, leading to large compression 
factors. The pgb formalism is trivially adapted to the 
case of discrete signals. We provided three examples of 
finite sequences, and showed the large compression fac- 
tors achievable using the pgb coefficients. 

Although we have not exploited it here, Eq. (J9j) com- 
bined with Eq. © allows the freedom to choose Gaus- 
sian basis functions of different widths and spacings. 
That means that in principle we can combine the time- 
frequency shifting with a scaling transformation, simi- 



lar to what is done in the wavelet approach and in the 
pyramidal Gabor function. In fact, the formalism is not 
restricted to Gaussians — it can be extended to any lo- 
calized basis functions as long as the unit cell area obeys 
AtAuj = 2tt. More research will be required on how to 
optimize the basis for a given signal. 

We fully expect that the pgb method and its gener- 
alizations, with its combination of simplicity, flexibility, 
accuracy, stability and efficiency, will provide a compet- 
itive alternative to wavelet methods. 
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